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ABSTRACT 



This paper compares teachtrs md trained observers as alternative 
sources of Instructional time data* These sources are compared In terms 
of both al located and engaged Instructional time^ where anocated time is 
that instructional time designated or assigned by the teacher and engaged 
time is that instructional time during which the student is actually attend- 
ing to the task. 

Data were collected in six second grade classes. Teacher records of 
allocated time were obtained over an eight-week period^ while direct ob- 
servation was conducted for a two-week period. In addition, seven days of 
paired observation were carried out by the two observers of this study* 
The results of the paired observation showed inter-observer reliability 
for engaged instructional . time In reading and mathematics to be at levels 
suitable for most research purposes. 

Analyses showed that teacher records of allocated instructional time 
were positively correlated at a reasonably high level with both allocated 
and engaged time obtained by direct observation. Adjustments of the teacher 
records using teacher estimates of student engagement rates did not gen- 
eraliy Increase the correlations between teacher and observer sources of 
data. Further analyses of teacher estimates of student engagement rates 
showed these estimates to be more highly correlated with a general measure 
of student achievement in reading than they were with estimates of student 
engagement rates obtainid by observation. 

Analyses of the relationship between instructional time and student 
learning led to the tentative conclusion that teacher and observer sources 
of instructional time data are comparable In terms of their association with 
student learning. These analyses also indicated that observed estimates of 
student engagement rates and combinations of Instructional, time categories 

could both be used to increase the association between teacher records of 
allocated time and student learning. ■ 
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I. INTRODUCTION 

There is currently a great deal of Interest among educational re- 
searchers In the relationship between instructional "Clme and student 
learning. Many of the recent studies of instructional time have been 
field-based studies that attempt to measure the time devoted to various 
areas of instruction in ongoing classrooms* However^ different studies 
have used radically different methods for collecting data on instructional 
time. School records of attendance and class schedules were used by 
Wiley and Harnischfeger (1974). Records kept by teachers were used by 
Gunip (1967). Various observational procedures with a time base were 
used by Flanders (1970) and by Stallings and Kaskowitz (1974). Despite 
this broad range of data collection methodologies for the study of in- 
structional tlme^ little is known about the relative merits of these 
different data sources. The present paper attempts to augment existing 
knowledgi of alternative procedures for collecting instructional time 
data by comparing records kept by teachers and data collected by trained 
observers. 

The comparison of teachers and observers as sources of instructional 
time data 1s of considerable practical and theoretical iniportance to 
researchers. With a moderate amount of trainings teachers are able to 
maintain records of instructional time at little or no cost to the 
researcher. However, it is impossible to obtain useful inter-teacher 
reliability data in most ongoing classrooms because there Is generally 
only one teacher Involved in a particular unit of Instruction. The 
collection of inter-teacher reliability data outside of the ongoing 
classroom (in a laboratory setting) would be difficult and costly. 
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Furthermore^ reliability determined in an artificial setting might not 
generalize to records kept by teachers in their own ongoing classrooms. 

Data collected by trained observers is generally subject to more 
direct control by the researcher than 1s data obtained from classroom 
teachers. Inter-observer reliability can be readily obtained in the on- 
going classroom setting, Alsot different observers can be assigned to 
the same classroom so that possible sources of bias are averaged with 
each other. In addition^ the researcher can usually conduct more 
extensive training and monitoring of observers under his/her direct 
employ than would be possible with regular classroom teachers* The out- 
side observer is also more likely to perceive instruction objectively 
than is the teacher who Is directly Involved in that instruction, -However, 
trained observers are an expensive coimtodity. As the period of training 
and data collection is increased, the cost 1s also increased. Outside 
observers also have the disadvantage of being obtrusive to the very 
phenomena that they must obsirve. The more detailed the observational 
records of student activities , the more the observer must move around the 
room and examine student activities closely. 

An additional complication of the measurement of Instructional time 
is the distinction between ''allocated" and "engaged" instructional tirro* 
Allocated time refers to that amount of time provided or set aside by 
the teacher for some instructional activity* Engaged time refers to that 
portion of the allocated time durfng which the student actually attends 
to the Instructional activity. Presumably, learning can only occur when 
the student is attending to or actively engaged In the Instructional task. 
Allocation without engagement would not be related to learning outcomes. 
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However, engaged time is usually more difficult to obtain than is allo- 
cated time. First, it is sometimes difficult to determine whether or 
not a student is actively engaged in an ongoing task. Second , complete 
data on engaged time requires the continuous observation of individual 
students. Otherwise, estimated rates of engagement must be determined 
over shorter instructional periods and applied to longer periods. Con- 
sidering the importance of measuring engaged instructional time and the 
complexities of doing so, a major purpose of this paper is the comparison 
of teacher and observer data on student engagement. 

The dati to be examined for this paper involve teacher records and 
direct observation of both allocated and engaged instructional time. 
This yields four basic measures: teacher records of allocated time, 
teacher records of engaged time, observation data on allocated time, and 
observation data on engaged time. In additionj examination is made of 
data combining teacher and observer sources^ wherein teacher records of 
allocated time have been adjusted according to observational ly meastjred 
rates of student engagement. 

The data to be reported were collected as part of the Beginning 
Teacher Evaluation Study (BTES) for the 1975-1976 academic year. This 
paper examines data collected during the fall semester of 1975 for 
reading and mathematics instruction in second grade classrooms. Teacher 
records of allocated time were obtained during the fall term over an 
eight-week period between the administration of a pretest and posttest. 
Direct observation of both allocated and engaged time was conducted 
over a two-week period within the same term» with additional pre- and 
posttesting for this two-week period. Teacher ratings of the average 
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dally proportion of allocated time during which a student was actually 
engaged were obtained for each student Individually (once during the 
term). In addition ^ observational ratings of the proportion of alio* 
cated time during which students were actively engaged were obtained 
by two procedures: 1) the ratio of engaged time to allocated time was 
calculated using the two-week observational data referred to above^ and 
2) the proportion of allocated time during which students were engaged 
was coded directly .by a time-sampling observation procedure conducted 
on one day during the term in each class* 

The procedures for obtaining teacher records and for collecting 
observational data of instructional time are described in detail in 
the second section of this paper (''Methodology and Instrumentation"). 
This section also includes data on the inter-observer reliability of * 
the observational procedures. The th1,d section ("Results and Discussion") 
examines the relationship between Instructional time as measured using 
teacher records and as measured by direct observation. Teacher and 
observer estimates of student engagement rates are compared. Final ly^ 
the third section includes a brief discussion of teacher records and 
observer data in terms of their relative validity for predicting student 
learning outcomes- 
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II METHODOLOGY AND INSTRUMENTATION 



Sample 

The field work carried out by Far West Laboratory during the con- 
tinuation year of Phase III-A of the BTES (see Far West Laboratory, 1975) 
Involved a sample of 33 teachers. This sample was composed of 16 Grade 5 
and 17 Grade 2 teachers. Each volunteered to participate In the one- 
year study. It was decided to conduct the reading and mathematics 
studies with separate samples of teachers. The teachers at both grade 
levels chose to participate In either the reading or the mathematics 
sample. 

The study reported here concentrated on the Grade 2 reading sub- 
sample, which consisted of nine teachers. Given practical and financial 
constraints s 1t was not possible to carry out extensive direct observa- 
tion In all classes. As a results six of the Grade 2 reading classes 
were selected for direct observation. Selection for the observation 
subsample was made on the basis of variety of instructional organization 
across classes and representation of Inner city, suburban, and mixed 
populations. All of the teachers selected agreed to be Included In the 
observation subsample. Since the direct observation required observers 
to be present for the entire school days it was feasible to collect 
information on both reading and mathematics Instruction. As a result, 
this subsample of s1x classes was treated as a regular part of the 
Grade 2 readinq sample of nine classes; but, in addition, several math- 
ematics scales were administered to the classes , and teachers kept logs 
of both reading and mathematics instruction. Therefore, the data for this- 
subsample includes both observer and teacher records of instructional time. 
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Design 

The primary purpose of the data collection conducted during Phase III-A 
of the BTES was to describe naturally occurring variations in allocated 
and engaged instructional timi, and to relate these variations to growth 
in student achievement. The strategy was to assess student achievement 
in a numbsr of content areas on two occasions; once early in the fall 
and once late in the fall. In the Intertest Interval records of alio- 
cated time were kept* The intertest period was chosen in such a way 
that a maximum interval was available without inconvenience to schools 
during the first two weeks of classes or the week preceding Christmas 
vacation. It was also necessary to have approximately ten days at the 
beginning of the school year for contacting teachers and instructing 
them in procedures for keeping records of allocated time. These practical 
time constraints determined that the first testing occasion (referred to 
as occasion A) take place during the first week of October, 1975. Records 
of allocated time were kept for eight weeks of instruction, after which 
the second testing (occasion B) was conducted during the first week of 
December, 1975, 

Im.add1tion to the records of allocated time, data were collected on 
engaged time by direct observation . The data on engaged time served two 
main purposes; first, it allowed estimation of the proportion of allocated 
time during which students were actively engaged^ and second, it provided 
data for relating student engaged time to achievement. For the second of 
these purposes, it seemed particularly important to assess engaged time 
over several successive days, rather than a sample of days. In this way, 
the engaged time in a particular^subject area' could be assessed relatively 
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accurately. Each class was therefore obsirved for two wefeks. In an 
attempt to create optimal conditions for the assessment of. the relation 
between engaged time and achievement^ additional achievement tests were 
administered at the beginning of the first observation day and at the 
end of the last observation day. These testing occasions are referred 
to as OA and OB respectively. The procedure provided 100 percent coverage 
by direct observation of In-school instruction for every student during 
the OA-OB period. Observation was carried out by two observers; therefore 
only two classes could be observed during any one two-week period. As a 
result, classes were observed In pairs during successive two-week periods 
within the A-B period. 

In summary^ all classes^ were tested during the first week of October, 
1975 (occasion A) ; al located time records were kept for eight weeks ; and 
then all classes were tested again during the first week of December, 1975 
(occasion B), Engaged time for each class was assessed by direct obser- 
vation during a two-week period, with associated pretests and posttests 
(occasions OA and OB). The timing of the observation periods was staggered 
in such a way that pairs of classes were observed during the same two=week 
period, Alj classes were observed between testing occasions A and B, 

Instructional Process Variabl es 

.The Instructional process data consisted of measures of both allocated 
and engaged time spent in particular reading and mathematics content areas. 
Within content areas, several Instructional settings were distinguished. 



The data set described here 1s a subset of the data collected during 
the continuation of Phase III-A of the Beginning Teacher Evaluation 
/Study (Far West Laboratory, 1975) , 
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Data were collected for every student in each of the participating classes. 
Allocated time was assessed by a log-keeping procedure and engaged time 
was assessed by direct observation. The present section of this paper 
describes the subject-matter and setting categories, the teacher log pro- . 
cedurei and the direct observation procedure. The final portion of this 
section describes procedures used in deriving two alternative indices of 
student engagement/ 

Subject-matter and instructional setting categories . Since instruction 
is planned and implemented by content areas and since student achievement 
is most often differentiated by content areas instructional time was 
first partitioned by content category. Subareas of reading (e.g. decoding, 
word meaning, comprehending main Ideas) and mathematics (e.g. , addition 
with regrouping, subtraction with regrouping, place value) constitute 
the categories. Reading and mathematics content categories were developed 
at two levels; general and specific. They were derived from a logical 
analysis of Grade 2 reading and mathematics objectives, textbooks, and 
curriculum materials. The original categories were modified and refined 
by classroom teachers during piloting. 

For Grade 2 reading, 10 general content categories were defined. 
These break down Into sixty-eight specific content categories. (All 
reading content categories are 1 isted in Appendix A; ) For grade Z 
mathematics, 10 general content categories were defined. These break 
down into twenty-seven specific content categories. (All 



^The category systems had a primary use related to the study of test 
reactivity (Filby & Dishaw, 1976); For this purpose the categories 
were designed to encompass the entire Grade 2 reading and mathematics 
curricula. " ■ 
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mathematics content categories are listed in Appendix B.) Specific con- 
tent categories were developed so that allocated time could be recorded 
in relatively narrow categories* However, it was not possible to use 
all of these categories In direct observation. As a result ^ the general 
content categories were also devised. In some cases, a general content 
category corresponds to one specific content category; in most, several 
specific categories make up one general category. 

Within the content categories, broad instructional settings were 
defined by three fundamental Instructional characteristics: adult in- 
volvementj pacing, and group size* 

The teacher-involvement facet had two elements. Settings in which 

^ .... 

students worked directly with a teacher (or other adult) were distinguished 
from settings in which a teacher*s primary attention was not directed 
toward the students being considered. This facet is important because 
the impact of a teacher^s Interactive behaviors and skills operates in 
the former but not the -latter type of setting, (The term "teacher" was 
used 1n the broad sense, to include any adult directly involved in in- 
struction,) If a class was divided into two groups at some point in 
time, and one of the groups was engaged In an addition drin with the 
teacher while the other group was doing seatwork, the students in the 
drill activity were in a setting with direct teacher Involvement, The 
students who were doing seatwork were in a setting which did not Involve 
a teacher directly, even though the teacher may have occasionally 
addressed one or more of them. If students were engaged In seatwork, 
and the teacher's main activity consisted of going from student to student^ 
to check or explain work, the teacher was characterized as directly in- 
volved, even though ha did not interact with all -Students In the gr^oup, 
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The^ pacing facet was included to distinguish between settings in 
which students proceeded at their own pace and settings in which they 
worked at a pace determined by the teacher (or some other characteristic 
of instruction). Pacing is very much a matter of degree; students never 
completely determine their own pace^ nor Is pace totally determined by 
external factors. Nevertheless, instructional settings vary considerably 
in this respect; and, as a result, the rate of student learning may be' 
strongly affected. As a crude operational ization of pacing, a distinction 
was made between seatwork and group work. Seatwork is the most, frequently 
occurring setting 1n which students have relatively high control over 
pace; group work 1s the situation which is most externally paced. 

The third facet of instructional setting was group size* The facet 
has been the subject of much research and ha& great intuitive appeal. 
It was included here, not because of Its potential direct effect on 
Teaming* but because different group sizes provide the opportunity for 
very different kinds of student activities, teacher behaviors, and group 
climates. The mere fact that a student is working in a small group does 
not imply that a particular kind of Instruction w1 1 1 occur; it does act 
as a necessary (but not sufficient) condition for certain highly-valued 
teacher behaviors. For Instance; the smaller the group, the more closely 
a teacher vcan approximate a tutoring situation with each student. However, 
a lecture to a group of five children is probably very much like a lecture 
to a group of thirty-five children. Group size, like the other facets of 
setting, was coded as a dichotomy. Large groups were defined to contain : 
ten or more students; small groups, nine or fewer, (Pilot experience 
showed that a lower value for the upper bound of "small groups" would have 
provided ..very 1 ittle. discrimination among actual classroom groups. ):.__^^^^ 



Teacher logs . The teacher logs were developed by the staff of the BTES. 
The logs served as the primary source for conecting data on allocated 
time. All teachers maintained records of time allocated to reading and 
mathematics instruction. These were referred to as "teacher logs." 
The logs provided Information on content covered and settings for reading 
and mathematics Instructions on a daily basiSs for groups of students In 
each class. The time allocated to each Instructional setting was recorded, 
with one or more content categories associated with that setting. In. 
highly individualized classes, teachers recorded the content covered and 
settings used for each student during reading mathematics Instruction, . 

The teacher log format 1s presented in Figure 2,1, Each one-page 
log covered one week of instruction for a single group of students. The 
names of the students in a given group were designated on the attendance/ 
group co/nposltlon sheet (shown In Figure 2,2). Each teacher listed his 
class roster on the left hand side of the attendance/group composition 
form. For a given week, the teachers then designated the reading and = 
mathematics Instruction groups for each student and the daily attendance. 
This procedure allowed for different grouping patterns in reading and 
mathematics. It also allowed for changes In the composition of student 
groups during the study. . 

Reading content was recorded according to the list of categories 
In Appendix A. Mathematics content categories are listed In Appendix B. 
Teachers referred to the list to find appropriate codes for content 
categories that best described the instruction. Teachers were also pro- 
vided with glossaries which contained examples of each of the content 
categories, and were indivlduany trained in the log^keeping procedure. 
. Practice logs were kept by each teacher for up to two weeks before data .. 
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collection began. The training and glossary were intended to ensure 
reliable categorization of content from teacher to teacher. Content was 
recorded using the specific content categories. 

In classroom situatlonst content tended to change more quickly than 
setting* For this reason, several content categories were often desig- 
nated for one Instructional setting. The starting and ending time for 
each setting was recorded, thereby providing a record of the instructional 
time allocated to the content covered in each setting. If several 
different categories were recorded for one settings (and therefore one 
time period) 5 then the teacher specified the time devoted to each content 
category whenever possible. Otherwises the total period of time was 
divided by the number of content categorieSs yielding an estimated time 
allocated to each category. 

The defining characteristics of instructional settings (adult involve 
ments paces and group size) have been described above* Direct involvement 
of an adult covered a range of activities from lecturing to monitoring 
independent seatwork. "Adult" referred to any teachers student teachers 
or aide. The same adult was not classified as directly involved in more 
than one setting at a time* Therefore s an adult would not be classified 
as directly involved in monitoring seatwork 1f that were a secondary 
function of the adult. 

Regarding the pacing facet: "seatwork" referred to any setting where 
students worked independently. Two or more students working together, or 
an'adult tutoring one students was classified as a group-work setting. 

The group size facet was not recorded by teachers. This categoriza- 
tion was made by coders when the teacher logs were returned to the 
Laboratory-for processing. Group size was. ascertained, by ..checking^.t 



number of students in a particular group on the attendance/group compo- 
sition forrru 

In addition to the Information noted above* teachers provided a 
brief description of the materials used in each Instructional setting: 
the name of a textbook and the pages covered ^ worksheets used for seat- 
work assignments, and the like. 

In summary* for a given week, each teacher recorded how students 
were grouped for reading and mathematics instruction on the attendance/ 
group composlton form. Daily absence records were kept on the same form; 
and If group composition changed during the week, the changes were also 
reported* On the teacher log form itself, teachers kept dally records 
for each student group. For each day, time periods were blocked off by 
vertical lines (drawn by the teacher). The beginning and ending times 
for a setting were recorded along the top of the form. For each setting, 
teachers recorded adult involvement, pacing, materials^ and content 
categories. In this way, varied instructional patterns could be recorded 
on the same form, (Examples of completed teacher logs and attendance/' 
group composition sheets are included in Appendices A and B.) 

Where teachers grouped students for instruction, this procedure 
worked well/ However, where instruction was highly individualized, 
variations were adopted. This most often required the keeping of records 
for individual students; or, where teachers operated a number of "activity 
stations," records could be kept for each station. 

Since the log procedures were quite new, relatively little was known 
before the study about their measurement characteristics,. Therefore, in 
order to obtain independent assessments of allocated time, two additional 
data sources were used, Firstr Far West Laboratory coders ^ who transferred 



the raw teacher logs into machlne-punchable formats, spent one day in 
each classroom, Durinq that day, the coders completed a log for the 
instruction that occurred. This log was then available for comparison 
with the teacher log for the same day. Since there was only one day of 
coder log per teacher, these data were treated in a clinical manner/ 
Second, at the end of each day of direct observation, the Far West Labora- 
tory observers completed logs* From this data source, seven to nine days 
of logs were made available for comparison with each teacher's log. The 
results of these comparisons are presented later In .this paper. 

Direct observation . Data collection by direct observation served two 
major purposes* First, direct observation cf instruction over a two 
week intertest period provided the basis for relating achievement to 
amount of engaged time. Observation of all school Instruction during this 
interval eliminated the problems arising from sampling of a few'^instruc" 
tional occasions from a relatively long Intertest interval. The obser- 
vation system was intended to capture all instruction relevant to reading 
and mathematics in terms of engaged time In content and setting categories, 
which could then be related to achievement measures. Th^ second purpose 
of the observation system was to provide independently collected data to 
compare with the allocated time data from teacherlogs. Howver, since 
observers assessed engaged time and teachers reported alloc^lsted time, 
quantitative comparison of these two sources (for purposes of determining 
-thejrel^ll ity^ of te was difficult. So, in addition to their 

daily observation task, observers completed an allocated time log of the 
day*s instruction/ These were used for comparison to the teacher logs. 

In the development of this observation system, the selection of the 
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level of specificity with which to describe clafiiroom phenomena was a diffi- 
cult problem- The usefulness and practicality of a content- or setting- = 
category can vary tremendously depending upon the number of facets Involved 
In its definition. The more specific the categories, the more difficult the 
coding of process datai especially when data are to be collected on every 
student in a given classroom, A decision must be made to collect either more 
specific information for a smaller number of students or less specific infor- 
mation on a larger number of students* 

In this case* the decision was made to describe instructional settings 
at a relatively global level. In terms of three dichotomous facets (adult 
involvementi pacing, and group size). Within these settings, content was 
noted In relatively specific categories. (The setting facets and content 
categories have been described above. ) 

During July and August^ 1975, Far West Laboratory staff observed 
teachers of Grades 2 and 5 In year-round schools operating in Fairfield 
and Hayward, California. On this occasion, attempts were made to code 
content in reading and mathematics In a large number of specific categories* 
It soon became clear that content changed ve y quickly when specific 
categories were used. For example, teachers handed out seatwonk dittos 
which Included work on a relatively large number of specific mathematics 
content categories* Clearly, 1t was Impractical to record the amount of 
time spent on each specific category by each student. 

After trying several alternatives, this problem was resolved by re- 
defining the content categories* Since the observation covered a two 
week period in the fall of the year, attention was restricted to a few 
specific content categories which were cormonly taught during that portion 
of the school year* The other content areas_ were collapsed into one 
broad category* 
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The observation categories chosen for reading were: 

1* decoding-long vowelSs 

2. other decoding 

3. word structure-compound words, 

4. other word structurst _ , . ■ 
. S. context clues I word meaning and comprehension 

6. reading practices 

7. areas related to reading. 

The relationships among the specific, general , and observation content 
categories in reading are shown in Appendix A. 

The observation categories chosen for mathematics were* 
1. addition without regroupings 

2- addition with regrouping, . 

3, subtraction without regr^ 

4, subtraction with regrouping 

5, place value and expanded notationi V 

6, other. V 

the relationships among the specific, general, and observation content 
categories 1n mathematics are shown in Appendix B. 

Focusing on a small number of content categories made observation 
much more practical, but did not solve all problems. Experfence during 
piloting Indicated that content still changed more quickly than setting 
variables (for example, grqup size or adult Involvement). Rather than 
attempt a perfect fit between content categories and the setting variables, 
more than one content designation was allowed fa^ any particular combl- : . 
nation of setting descriptors* These setting descriptors (adult involve- ^ 
ment, pacing, and group s1ie) were identical to those used 1n the teacher 
logs. The adult-involvement setting facet was coded by using "A" to 
represent cases where the teacher was directly involved and "N" for all 
other cases. Pacing was operatlonalized as seatwork (coded "S") and ^ ^ 

everything else (coded "0"), Small groups (coded *'L") were defined as 
having nine or fewer students. Settings with ten or more students working : ^ 

on the same activity were desi ghaS^ " 
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The' basic strategy of the system was to code all Instruction in 
reading and mathematics for each student in a classroom* This was done 
by tracking the time students engaged in particular settings In terms 
of teacher involvement 5 pacing^ and group size, and subsequently coding 
the content covered within each setting, (For each setting one or more 
content categories were recorded.) 

Experience during piloting indicated that one observer could monitor 
classes of up to. thirty students for this information. However, rt was 
essential that the observer know the general routine of the classroom, 
the materials, and also be able to distinguish one student from another 
rapidly* These requirements were met by having an observer spend one 
full day in a class before data collection began. This procedure allowed 
teacher and students to become accustomed to the observer,^ and provided 
the observer with practice in each classroom. - 

Direct observation procedure . Observers collected data over two conse- 
cutive weeks 1n each classroom. One day was required for memorization 
of the students' names, and familiarization with the general classroom 
routine. The remainder of the time (approximately 9 days) was available 
for official data collection. 

Once the observer was familiar with the classroom organization and 
students, ,the procedure was relatively straightforward* The observer 
entered the classroom with the students each morning and used the obser= 
vation coding form (Figure 2.3) to record data. (The coding form used 
in the field was 8-1/2 inches by 14 inches. It has been reduced in size, 
for display in Figure 2.3. ) Students' names were placed in the columns. 
The four lefthand columns were used for recording starting and ending- 
times j teacHir^invol vemen t and'^paci rig codes 
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The form was used in the following way. The observer noted the 
starting time for any group setting wherein reading or mathematics was 
the content. All times were recorded to the nearest minute. Teacher 
involvement and pacing for each group were then coded in the .appropriate 
columns. Final ly, the content was coded in the cell below the name of 
each student in that setting. 

If the content was the same for all students In a setting ^ then 
the content was coded for the student appearing first in the list; and 
a horizontal line was drawn across the appropriate cells for each of 
the other students in that group. This indicated that the content code 
was the same for all students in that group. In the simplest case, 
where a setting came to an end at a particular time for the whole group, 
the ending time was recorded* If some students in that setting covered 
^different categories^-of content 5^then...those 
the names of the appropriate students. If one or more of the students 
in a setting left that setting, then the end time was entered in the 
cell for that student directly under the content code. In this way, all 
students who started out in the same setting could l^ave it at different 
times and still be accounted for. If a student entered an existing 
setting after It started, then the observer coded tha*- student's start 
time under his name and then coded the content. Thus, if a cell for a 
particular student began with a time, it was Implied that the group 
time entered in tiie far left column did not apply to that student. If 
the last entry in a cgII for a particular student was a time, it implied 
that he left the group before it ended and the end time for the setting 
(second column from left) did not apply for that student. Similarly, 
if a student started off in setting A, changed to setting B, and then 



-22- 



returned to setting A again, the sequence could be coded. The cell under 
the student's name might contain a content codes a time, another time, a 
content code^ and a third time. This configuration would represent a 
case where the student started the setting with the whole group and was 
working on the content listed first. This work continued until the first 
time listed in his cell, at which point the student changed to another 
setting. At the second time listed In the cell , the student returned to 
the first setting and worked on the content listed next in the cell. The 
final time recorded in the cell represents the point at which the student 
left the setting again, and, in the example being considered, the setting 
continued to exist after the student*s second departure: The time during 
which the student was not In the setting being discussed could be accounted 
for by looking In another row on the form (that is, in another setting). 
... ..^ ......... However 5_no t e„ t ha t ^ ^ 1 f t he in teH m^ s e t y ng^ 1^ or 

mathematics I then no entry would have been made for that interval. 

To recapitulate- each row on the form represented a setting as 
defined by teacher Involvenient and pacing. Several rows could be active 
at any one time. Content and Information which was associated with Indi- 
vidual students (as opposed to groups) was recorded In the columns of the 
form under the names of the particular students. In this way, one 
observer kept track of all the students in the class. Note that when a 
student was working on content which was not recordable within one of the 
categories of reading or mathematics as defined for this study, no 
codes were recorded. 

Group size was'not necessarily Included In the set of codes. However, 
the group size for any setting could be recovered from the codes already 
described. For a particular student at a particular time, group size for 
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the setting could bi determined by examining the row In which the student 
was included and counting the number of students in the row at the same 
point in time, (As previously stated: for purposes of analysis, group 
size was considered a dichotomy j small groups defined *as having nine or 
fewer members 5 large groups as having more than nine* Since the exact 
group sizes were available from the raw datas this cutting point could 
be easily changed for additional analyses.) 

The space at the right of the sheet was used for comments or clari- 
fications as they were required* Forms with the names of students were 
printed for each class. The names of teacher and observer and the date 
of observation were also recorded on each form. 

In carrying out the observation routine , 1t was necessary for the 
observer to move about the room to look at materials being worked on by 

StudMts*__ Jxpe^ a thorough 

knowledge of the materials actually being^used by students. This was 
especially true in cases where the program was highly individualized. 

The observation procedure was designed to collect information on 
engaged time. If students were not engaged in the task at hand, then 
time was subtracted from each setting for each student depending upon 
how much time that student was unengaged, V/hen time was subtracted for 
unengagement ^ it was done so in multiples of one minutei momentary in-- 
attention was ignored. 

Engagement was judged by the observer with the aid of several guide- 
lines. When students were working on tasks which required an overt 
response, engagement was relatively easy to Judge, When students were 
working on tasks which did not involve overt responses, the situation was 
somewhat more difficult. In the latter cases ^ observers used student eye 
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contact and body position as Indicators of engagement. If a student was 
in a discussion group, watfhing the various speakers in turn and apparently 
following the discussion, then the time was considered engaged time. If 
a student was discussing an unrelated topic with other students, or was 
clearly not attending to the task, then the time was considered unengaged 
time* The distinction was fairly crude; students were considered unengaged 
only when the situation was unambiguous. 

Observer reliability . The observation data were collected by two observers. 
After approximately two weeks of training, the observers simultaneously 
collected data in two classrooms over a four day period for reliability 
purposes. Both observers went to Class A for two full days and then to 
Class B for two full days. The data obtained in this period were trans-' 
ferred to the standard coding booklets and times were collapsed over days, 
classes and setting codes, so that total engaged times were available for 
each student for each content category from each of the two observers. 
Interobserver correlations were computed ^ and showed good agreement on 
most content categories. 

After this post-training check, the observations were carried out in 
the study classrooms. This required approximately six weeks. Following 
the data collect ion , the observers returned to the same two classes and 
simultaneously observed Class A for 2 days and Class B for one day* 

These data were processed along with those collected at the post- 
training period. The data were collapsed over the seven days (four pre 
and three post) of observation, yielding total time in content-by-setting 
combinations for each student from each observer. Interobserver corre- 
lations are discussed below separately for reading and mathematics. 
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The Interobserver correlations for each reading content-by setting 
combination are presented 1n Table 2,1. For the calculation of inter- 
observer agreement indices, the students from both classes were pooled, 
yielding a sample of 45 students. Some setting-by-content combinations 
were rarely (or never) observed during the seven day 
resulted In some correlations being calculated on distributions with 
very little variance. In some cases only one^student had a non=zero 
engaged time. This accounts for many of the low correlations. Where 
the distributions were all zeros for both observers^ two dashes appear 
In the table. These represent cases of perfect agreement; that is, 
neither observer recorded any time for any student In that content-by- 
setting combination. Where there was a reasonable amount of time 
recorded, the correlations ware relatively high, indicating that engaged 
_ time In^content-byr setting comb1natlons_can_be reliably 
different observers. 

The setting information was used for descriptive purposes only. 
Time in content areas was used both for descriptive purposes and in 
analyses of time in content with achievement. The bottom row of Table 2, 
presents the interobserver agreement when the data were collapsed over, 
setting. Note again that the coefficients were relatively high. 

The Interobserver correlations for each mathematics content^by- 
setting combination are presented in Table 2.2, The discussion above 
of Table 2,1 for Interobserver correlations in reading applies equally 
to Table 2,2 for mathematics. As for, the reading data^ the bottom row 
of Table 2,2 presents the interobserver agreement when the mathematics 
data were collapsed over setting. Note again that the coefficients were 
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Table 2.1 



Intirsb|gri/Er corrslatisns for content category by setting cofflbinations. Data wire collectid 
in two CiiSirooiTiS over a totsl of sevin ichoel m< Fsur of the days occyrrid after training 
.but bifore the nudy data wire coliectid, while three of ths days occurrid after the study dits 
were coll acted, 



Whim mm wtegories 



Setting 
Combinitioni 


Long 
Vowels 
(RL) 


Other 
Decoding 
(RD) 


CompQund 
Words ^ 
(RC) 


Othif llQfd 
Stryctyre 
(RS) 


Cofnbinid 
Compfiliinilon 
(RH) , 


Reading 
Practice 

Wl 


Anas Related 
To Rssding 

M) 


ASH 


.55 


•45. 


.40 


.30 


,35 




M 


,ASL 


-.04 . 


.43 


.,00- . 




. -.04 






AQH : 


1.00 


.93 






M 


hOu 


1*00 


AOL 


.§9 


.62 




.00 


.23 






NSH 


.00' 






.00 


.00 


M 




NSL "% 


__b 










M 


=.06« 


NOH 
















NOL 


1.00 








-.12 




All Sittingi 
Combined 


.95 


.91 


,53 


■ .94 


,85 


.64 


,9? 



Noti tabir of lubjacts ^ 45 



A Mdult dlraetly Involved N s no idult directly involved 

•S- mtmr^ 0 ' other (nDn-iiitwork) - 

L - low group sizi • H - Mgh group s1ie 

Thiii coiffidents represent mm where only a few students had non-zerQ tifiies aiieised by one or both 
Qbsirvers, ■ SiViR of the.eQefficienti had bitween five and eight itudents 'ivith non^iero tloieii while the 
othiri had threa students with non-zir^ 

i " indicates pirfect agreeTCnt between observers but all students had ziro recorded tifna.. 



-27 = 



Table 2,2 
Mathematics 

Interobserver correlations for content category by setting 
combinations. Data were conected in two classrooms over a total of 
seven school days. Four of the days occurred after training but before 
the study data were collecteds while three of the days occurred after 
the study data were collected. 







Content 


Categories 








Settings 


Maai ti on 

Without 

Reg. 


Add! ti on 

With 

Reg. 


Sub, 
Without 
Reg . 


Sub. 
With 

Reg. 


Place 
Value 


Other 
Math. 


ASH 


.75 


. 00* 


.70 


.00* 


.59 


.78 


ASL 


.00* 




.00* 




.00* 


.00* 


AOH 


-.00 




.00 


.'93 




1.00 


AOL 
NSH 


.88 

__ a 




.79 






.98 


" NSL 












Too*^ 


NOH 














NOL 


.77 




.00* 








An settings 
combined 


.71 


.00* 


.87 


.47 


.69 


.93 



Note: Number of subjects - 45 



A = adult Involved N ^ no adult Involved 

S ^ seatwork 0 ^ other (non seatwork) 

L - low group size H - high group size 

^ A Indicates perfect agreement between observers but all students 
had zero recDrded time* 

* These coefficients represent cases v;here only a few students had non-zero 
tini^s ^ssosse^ om or Hnth nhsprvpr?i* Onp of thp starred c^^fficipnts 
has 5 students with non-zero times, while the others have 3 students or 
fewer with non-zero times. 
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relatively high. (The coefficient for subtraction with regrouping (0.47) 
was an exception. Very little time was recorded 1n this content category 
and the low correlation reflects the lack of variance.) 

Student engagement rates . Although the direct observation procedure 
provided Information on the amount of engaged time students spent in a 
two week instruction period, there was no direct information available 
on student engagement rates . Two methods of estimating engagement rates 
were tried. 

As noted earlier, observers completed a log at the end of each da^^ 
of observation. This log contained the amount of allocated time In 
reading and mathematics for students in the clasii for a particular day. 
For most classes* there were seven full days of instruction for which 
both allocated time from observer logs and engaged time from direct ob- 
servation were available (one class had six days). For each student, 
the total time allocated to reading and mathematics and the total engaged 
time in reading and mathematics were calculated (over the 6 or 7 day 
period). An observed engagement rate was then computed for reading and 
for mathematics for each student by taking the ratio of total engaged 
time in reading to total time allocated to reading and likewise for 
mathematics. 

Since the observed engagement rate could be computed only after 
extensive observation of each student, it was desirable to find an alter- 
native procedure that would be less expensive. The alternative procedure 
was based on adjusted teacher ratings of student attentiveness . Teachers 
were asked to rate each student in terms of the percent of the time that 
the student paid attention during class. These ratings were made twice: 
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once for instructional settings where an adult was directly involved, 
and once for settings where no adult was directly involved. The percent 
attentlveness ratings were made by placing a check in one of nine cate- 
gories * where each category represented an increment of 10 percent on a 
0 percent to 100 percent scale. (The directions to teachers and the two 
rating forms are included in Appendix C, By an oversights the category 
representing 31 to 40 percent was omitted from the form*) 

The teacher ratings of attentlveness were assigned the mid-category 
value; that is, a check In the 81=90 percent category was assigned a 
value of 0*85* This provided a distribution of attentlveness scores for 
each class. However, comparison from one class to another would be 
hazardous, since errors due to teachers' tendencies to rate high or low 
would appear as between-class differences. In an attempt to correct for 
possible teacher _b1as^ estimates of jmMn_en^^ 

The estimates were based on data collected during instruction in 
reading. An observer visited each class for one day. During the reading 
instruction periods * the observer counted the number of students engaged^ 
and the total number of students nominally working on reading. This 
procedure was repeated every four minutes. In this manner, average class 
engagement estimates were calculated. The reliability with which student 
were coded for engagement in different classes was acceptable, ranging 
from .65 to .85. The results of this procedure are shown In Table 2,3. 

These average class engagement estimates were used to adjust the 
teacher ratings of student engagement. The adjustment was made in such 
a way that each adjusted class mean was equal to the average class engage- 
ment estimate. The adjustment 1s specified in the following equation: 



Table 2.3 

Estimates of average class engagement during reading instruction 
for eight Grade 2 classes. 



Class 


Average Number 
of Students 
Observed 


Number of 
Time Samples 


Time Sample 
Interval (Mins.) 


Average i 
Engagement 


1 


15 


18 


4 


.44 


2 


11 


44 


4 


.49 


3 


19 


27 


4 


.25 


4 


7 


. ■ 41 


4 


.59 


5 


15 


23 


4 


.41 


6 


16 


31 


4 


.51 


7 


m 


33 


4 


.55 


8 


7 


38 


5 ' 


.50 



^AUhuugh there are nine classes in the sample, this procedure was carried 
out in classes 1 through 8. No data are available for class number 9, 

These estimates were calculatec frum one day of observation per class. In 
all cases data were collected dur^'ng class time which was allocated to 
reading activities- Since teacher^i allocate varying amounts of time to 
reading, the time period covered by the observation differs considerably. 
The observers counted the number of students engaged at four minute 1nter= 
vals (with one exception). They r^xorded the number of students engaged, 
the time, and the number of students in the classroom who were part of the 
BTES study and who were nominally working on reading activities. The 
average engagement was calculated by summing the number of students engaged 
over the* total number of time samples and dividing by the sum of the number 
of students in the classroom being followed by BTES and nominally working 
on reading activities. No distinctions have been made between setting 
combinations or subar^ ;s of content within reading. 
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where Y,. is the adjusted teacher rating of attenti veness for student i 
in class js R_.j 1s the teacher rating of student attenti veness, Rj Is the 
class mean of the teacher ratings of student attenti veness for class j, 
and Fj Is the mean class engagement estimate for class j\ This procedure 
prevents Y^.j from being negative^ and preserves the relative ranking of 
students within class, 

^ Data Col lection 

The data collected for the nine Grade 2 classes are summarized " 
schematically in Table 2,4. Note that the classes numbered one through 
six comprise the observation subsample for which data are presented In 
this paper* The eight-week test data were comprised of the scores 
obtained from testing occasions A (first week of October) and B (first 
week of December). The teacher log data describe the reading and math- 
ematics instruction for the A-B intertest period. The tvvo-week test 
data were comprised of scores obtained on testing occasions OA and OB. 
For Classes 1 and 3, this period fell in the latter hal f of October, 
For the remaining two pairs of classes, (numbers 4 and 5 and numbers 2 
and 6), the OA-OB interval came during the first and last two weeks of 
T^iovember respectively. The direct observation data and observer log 
data describe reading and mathematics instruction during the OA-OB 
interval, 
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SCTiaiy jfjata'collictd on nine 'Mis ^ 
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?, repiisents readinr aataj '. -j-immi: irathtmaticD data. 

Classes 1 through 6 comprise the observation subsaraple for which data are presented in this paper. ■ 
The one day coder log and the coder estiniate of mean class engagement were not obtained for class 9. 
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At occasions A and B 5 the reading battery was administered in four 
: 45-m1nute group testing sessions and the mathematics tests were adminis- 
tered in a group situation over one 30-minute period. They were admin- 
\1stered by Far West Laboratory staff , but not by the observers* At the 
OA and OB occasions s both mathematics and reading tests were administered 
one 45-minute session. This testing was administered by the observers. 
All test administrators were briefed on the testing procedures and 
approximately half of the testers administered at least one of the tests 
In a classroom practice session before testing began. Those test admin- 
istrators who did not have a practice administration acted as observers 
at least once while a test was being administered to a class. Test admin- 
: - Is trators compl eted tes 1 1 ng report forms 'after every admi nis t rat 1 on , and 
were debriefed after testing occasions A and B, 

Data collection for the teacher logs began early in September w1 th 
. one-to-one meetings with each participant. Materials on log-keeping were 
: explainedp and teachers began to keep practice logs up to two weeks before 
the A testing occasion. Each teacher was visited several times so that 
any questions about log-keeping could be answered. The amount of feedback 
which teachers required varied considerably. The more complex the organ- 
ization for instruction wass the more compl Icated the log-keeping became* 
I; : Once the class rosters were finalized and teachers *had some practice, 

the log-keeping seemed to go smoothly. Teachers were asked to complete 
; their logs each day, and to return them to the Far West Laboratory by 
mail every Friday. This procedure worked quite well, although teachet^ 
were sometimes late in returning logs, and It is not certain that all 
teachers completed them at the end of each day. 

Data collection for the direct observation procedure began with 
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arrangiments with the teacher for a tavo week period for observation* At 

this timfis the observer obtained an out! ine of class room routine and 

discussed the nature of the observation with the teacher* It was made 

clear to the teacher that Information on engaged time in Instruction 

for Individual students would be collecteds and^that no data on teacher 

behavior were being recorded* The OA and OB testing was discussed, and 

teachers were told what scales would be administered* In addition, 

teachers were asked to spend time on instruction in decoding long vowels 

and in place value. This request was intended to ensure that all students 

would have at least some time in a common content category* It was . 

desirable to have significant amounts of engaged^ time In one or more time 

categories; otherwise it would be difficult to demonstrate growth in 
achievement over a two-week period* 

On the first obs elevation day* the observer memorized the names of 

students who were to be observed^ and became familiar with the classroom 

routine. During this days the observation procedure was practiced in 

this new settings and teacher and students had time to become accustomed 

to the observer* Every day during' the observation periods the observer 

entered the class with or before the students and remained for the entire 

school dayy This allowed the coding of all instruction .alevant to 

reading and mathematics . On the second day of the observation period^ 

the OA testing was administered by the observer* Immediately after the- 

testing^ observation data collection began and continued during in-schooT 

hours until the OB testing date* 
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Characteristics of Teacher Anocated Time Logs 

The teacher logs provided measures of allocated time over the A-B 
period. At a practical level, the procedure proved=workable. Teachers 
were able to use the content and setting categories , and to keep records 
of time allocated to various kinds of instruction. The procedure was 
also flexible enough to allow data collection in very different classroom 
organizational structures. Comparison of the teacher logs with observer 
logs provided information on the accuracy of the recorded allocated times. 
The observer logs had been completed at the end of each schooT day during 
the OA-OB period. (This task was a secondary priority for the observers, 
since all of their In-school time was taken up with direct observation; 
and after school hours * their primary task was the transference of direct 
observation data from the observation coding form to the standard coding 
booklets.) 

The allocated time logs completed by the observers differed from 
the teacher logs in at least two important ways , First, observer al lo- 
cated time logs recorded content at the level of general content categories 
while the teachers ' logs used specific content categories. This mismatch 
prevented the Gomparison of anocated time^wi thin all of the specific 
content categories s but did allow comparison of allocated time within 
the general content categories. 

Second, the observer logs were coded for content using. a strategy 
referred to as "focus coding.'- This requires that an instructional \: - 
activity be placed in one particular content category, if possible— -r- 
the most complex category which describes the activity. (Multiplication 

o ■ ■ ' ■ ■■■■^ ■ ■■ ■■ " 
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would be coded as "multiplication,'' an^ part niultl plication and 

part addition, even though addition is part of the multipl ication process ,) 
When contents were covered in sequence, each was coded with Its appropriate 
allocated time, but where contents were coextensive intimej the more 
complex content was coded* This focusing on one content category was 
used in direct observation and hence pa^rried over into thje coding of the 
observer allocated time logs . . ' 

The teacher logs, on the other hand, used a strate^ referred to as 
"multiple coding" for categorizing content- In this procedure, teachers 
are encouraged to use more than one content code, if it improves the 
description of the activityt In processing the logs, if an instructional 
activity received more than one content code for a time interval, the 
time was distributed equally over the content codes* The same activity 
can be coded quite differently, depending upon whether focus coding or 
i_jnult1p1e coding is used. In spite of these differences, the observer logs 
. were the best source of Information for checking the accuracy of teacher 

allocated time logs. Data are presented be! w comparing teacher records 
of Instructional time with observer records. These data are presented 
and discussed first for reading, then for mathematics. 

Tables 3,1 through 3*6 present comparative data on observer and 
teacher logs of reading instruction. Each table presents information 
on one teacher. The tables are identical 1n format. These tables deal 
only with the content information of the logs. 

The tables are based on teacher logs, observer logs, and direct 
observation information for days when all three sources were available 
for a given class* Table 3,65 describing the log cherracteristics for 
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Table 3,1 



Means standard diviations,and correlations for Class 1 on allocated time from teacher logs, adjusted allo- 
cated time froiii teacher logs, allocatid time from obsarver logs, and engaoed time from dlract observation. ■ 
These data are summid over seven days of instruction' for iich all three sources of -time information were ■■ 
available. (fj> 16) ■ . - - : 

• , ■ Class i .l-'r' ■ ; : . 



: Contint 
Category 


Allocated Tinii . 

f™ Tsarhflf 

Logs 


Adjustid Alio- 

La Leu j iiiig i \ yjii 

Tiicher Logs 


Allocited Time 

1 1 yijt yusei f €1 

Lop 


Engapd liiHi 

1 1 yjii u i I €w k 

Obiirvaiion 


/AC 


'^AD 




1 A fin i/f^uslc 

Luny tui/eis 

(GCC 1)' : 


(15) 


\i 

• (?) 


/in 

(27) 


24 

(23) ^ 


.63 




•37 ■ ; 


Tstil dprodinQ 
(GCC 1.2) .: 


f\rf\ 

(75) 


\U 

- - (63) _ 


256 
(65) 


176 

■ •(40) 




.42- 


- J2^-;; 


rniiinfliifiH wfiH^ 

(GCC 4) 


^ (31) 


. (14) 


2 

(3! ■ 


IfS 

(35):_ 


.24 


.85. 


.67.^/ 


Total word itructure 
(GCC M) 


(43) 


3D 

m 


4/ 
(24) 


(41) ^ 


.30 


.96 




Reading practici 
(GCC^g)^ . 


III 
(14) 


53 

(li) . 


431 

(57) : 


71 

(20) 


-.48 . 


1 .,,00 


.19. 


Other reading 
(GCC8) " 


u 

■ : (11) 




(35) 


(12) 


-.96 


-.80 


-:?r ' 


Context cIupi 
(GCC 3) " 


bo 
(20) 




140 
(58) 




: .89 






Word oisaning 
(GCC 6) 


.. 33 

: (6) / 




13 
(8) 




-.14 






Coniprihension of text' 
MJ) 


m 




10? 
(23) 










Total OTipreliinsiQn 
(GCC 3,6,7) ; 


^ 114, 


50 


■ ' 260 . 

: : (8if^^^ ^ 


76 ■ 
(43) 


-.06 


^,07 


.39 • 


Total reading 
(GCCl througli 9) 


- 629 
. (53)- 


m 

(104) : 


^ 1062^ 

(148) : : 


410' 

■(85): 


/ .67 


. .70. 


■ .;.42 - O 



-general content category numbfrs are shown in parentheses. 




Means, .standard deviations,- and correlatioiis for Class 2 on allQcated time fm tsacher lop, adjustid alio- ;■ 
•cated tiiiie frooi tiicher lop, aliocatad time frooi direct observation; 

These data are summed over seven days of instruction for which all three sources of time information were 
available. , (f^ s ]g) . 
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Content 
CateQorv 

»™»W3*'«J .... 


Allscated Time 
froffl Tiichir' 


■. fi',' ; 

Adjuitid AIIq-' 
catid Tinii frQm , 


„c 

Anocatid Timi 
ffoni Qbsirvir 

LUys 


■ Engiged Tioii - 
fronrDirect 
Ob^eri/ation 








Long vowels 
IGCC 1 j 


: (11) 


(e) 


-13 ■ 
(15) 


(3) ■ 


.98 


' .82 


.83 


Total decoding 


. 254 
.....(52) 


124 : 

(28) 


188 
(48) 


104 
(35) 


.9r 


?4 


.73 


fepoundWQfdi 


,1 

(1) . 


0 \ 

(1) 


...... .. „ 


(5) 


1.00 


.91 


.91 


Total word itructufe 


: ]1 
(19) 


(9) 


■ 11 
(11) 


11 

(15) 


.98 


.91 


.92 


-Riiding practtci 
(GCC 9) 


118 
. (33) 


(18) : : 


88 
(3?) 


132 

444) ; .. 


.56 


.69 


.56 


Other reading 
(GCG 8) 


05 
(21) 


: 41 

(11) 


. 44 ,. 
(16) ; 


25 
,(12) 


.69 


.51 


.47 


Contixt clyei 


I 

(9) . 




0 . 
(0) 




: .to 






Kjrd msaning 
"(GCC 6) 


..^ ■ ■ 0/. V- 

- (0) ^ 




0 

■ (Q) ^ 




■ J 






ConpfihinSion of text 
(•iCC 7) 


:V -Si 

: m 




; (§) 




.30 






total conprghens ion 
■(GCC. 3,6,7). . . 


■ ■ ea : : 

-(23) 


. : (10) ■ : 


' ^ : 1/^ : 

. (9) 


■ (il) . ^^ 


.5J 


.29 


.31 


Total reading 

(GCC l through 9) ' ■ 


v'-(ilO) 


^ 2?3 :^ 

(60) ; 


^ '348 : 

:M V 




.g5 


■ .84 


.76 - 



.V. .^ General contgnt category nuin^^^^^ 

o ■ ■ . 

"^'l^'^^^VP^rf^ct agresment between sources of time infomation howgvsr then was no variance On either variable.- 



Reading 

Means, standard deviations, and correlationi for Class 4 on inQcatid time from teichir logs, idjusted allo- 
cated time from teacher lop i allocitad time from observer logs, and engaged timi from direct obsirvation. 
Tliase data are summed over seven days of instryction for which all three sources of tira information were 
available, (N = 14) 

Class 4 



Content 


A . 

Allocatad Timi 
from Tiachir 

i Ant 


E, 

Adjuitad Al lo- 
cated Time from 


c 

Allocated Tiraa 
ffoin Obiirvir 


0 

Engaged Time ' 
frooi" Direct 
Obsirvation 


^AC 


■"ad' 




Long vowels 

i] 


20 


13 


2J 
f9nl 


6 

finv 


.?4 


' .71 


.64 


Total decoding 
fGfC 1 1) 


90 

[Sij 


54- 


185 


m 


.48 


.45 


.39 : 


Gonipound words . . 


23 ^ 

li\ 
{') 


14 


1 

(]] 

VI 


13 


.04 


.25 


.44 . - 


Total word structuri 
(GCC 4i) 


23 
(1) 


14 


16 

fa) 


13 

(3) 


.04 


J 


.53 - 


Rsading practke. 
(GCC 9] 


143 


84 ^ 


m 

(^01 


12? 
(69) 


-.18, 


.13 


.35 


Other reading 
(GCC 81 


8 


[11 


73 
U]) 


40 
(35) 


.6? 


.49 


.55 


Context clues 
(GCC 3) 


1 

(11) ■ 




0 

. . (0), . 




JO 






yord rsaning 
(GCC 6) 


65 

_ m 




0 

(0) 




J 








5? 




.. 96 . . 
(30) 










Cofnprahension of text 
(GCC?) 


(30) 






-.23 




55 


■ Total coffipraheniion 
(GCC 3,6,?) . 


An . 

(52) _ 


78 

(36) 


(30) 


3? 

(16) 


•.06 


.24 - 


V'.23j;;: 


Total reading 
: (GCC 1 through 9) 


394 

(90) : , 


235 
(79) 


654; ^ ::. 

, , (104) 


^ 412 
(^9) 






^ .63-. .;' 



jineral content category fiumbiri ire shown in pargnthesiSi 



Tibli3.6 ■ 
. Reading , 

i'leans, standard dsviations, and correlations for Clais 6 on anocated tloie from teacher logs, adjusted alio- 
eatfid tiini from teacher logSj' allocated time from obsirver logSi and engaged time from direct obiervation, 
These data are sumnied over six days of instruction for which all three sources of time information were • 

available. (N ^ 18) 

. , , Class 6 . 



Content ■ . 
wfltcyurjf 


A . 
AlloMted Tinii 
from Tiichir 

1 hf\i 


. B 

Adjuitsd Ailo- 
catad Tiiiii from 
Teachfif LoQi 


Allocated Timi 
fro^i Obiirvor 
Logs 


0 

Engapd Time 

frfiniDirict 

ObsirviitQn 


^AC ■ 






Long vowel 1 
(GCC 1)" 


32 


18 


19 
(5) 


18 
(22) 


.90 


• .47 


.56 


Total decoding 
(GCC 1,Z) 


201 
(32) 


103 
(43) 


m 


79 

(to/ 


,66 


.34 


.31 


. Cgiiipound words 
(GCC 4) 


1 

(6) 


1 

III] 


n\ ' 

[ll 


1 


1.00 


'.06 


•^^ . 


Total word itructuri 


3 

is) 


2 


18 

\\Lj 


a 

(7) 
I'/ 


.94 


.03 


.03 


Reading praetici 


9? \ 
(21) 


(21) 


46 
(27) 


24 
(10) 


.30 


.22 


-.09 : 


Other reading 


49 

(18) 


26 

[\2j 


8 


7 

(7) 


.35 


.33 


.48 ■ 


Context clues 
(GCC 3] 


3 

(7) 




0 

(0) : 




.00 






Word rianing 
(GCC 6) 


]1 

:m 




0 

io) 




.00 






Cciiiprghgnsion of text 
(GCG J) 


(i) 




186 
(58) 




.14 






Iota! OTiprehension 
.:(GCi; 3,6,?) 


24". 
(19) 


11 

V (10) 


186 
(58) 


M 
(31) 


. .24 ; 


-.20 ■ : 




Total riiding . 
..(GCC 1 through 9) 


. : 3?3 , : 

■.■■(65) ■ 


192 

vn 


423 

(79) 


182 

■(42)-: 


J4., 


- .47 


:..71.y.;- 



■-iniril cfliitent category niiUberi arMhqm in parinthiiii, 



4 



4 



4 



ik i, ii WontofiiiKJaj! oftoicti. life fsr 
Hi ilf fifg ckii sri tl kii i infsition fi m^. ifi of 

Hi m of ici tils ire 111 
MMm 1 1, ipJlirpeit^ui 
ti M t^im fE^fertiielj. i list ri pigii total fit ■ 

iMM tii fri tte teiif lop. loli C fut ikM tit 
froi k torn lop. Iiftitli ii iW pral [iteit citpK 

i k]M for colli I M d nice tie lop piiW tte inforitioi. 
Colli I li i profiie tli liik t§im for ilkitd tii, Eoli 

ilitotati, SifitetteiirEctfitaf' 

prisUifii],ieinuoliDareili, illttJtii 
fi k tafc lip w iiltipliei 1| tli i^lii tiler fitiip of 
^tutat iMmB [kmi }mui\il mki nkmi to ' 

ii "af itii jllofjj til fri tiNr lop" ii pmii % k tilK 
anoliiL 

1 pirpe sf tilcyliti'i tiE lijustii iMM tiiE i to Jlloi 
coipri^oi iiti tie epJ tti fi M km\!m, Mm, 
coll I }mii to ii ofll| ttee m (jmiril csitit citipriB) ■ 
for ilici gippj til fi M oteiitii ifiilile, (slip! • 
i li I ik ih I toprii of mmi iMli- ii ' ■ 

pftii fi ifiJifrtrt soirees, iitii to ipiriiofl of 
Bfis li Mi iMMyM itli of km fMmii ■ ■ 
mktioKoeffitiEntiwereciloilitii Ifirftjt^jjte^rite. . 



HmHfillMtsatIi, Isisffli, 
, mssnftuslitii lii jllrtii ill ffi Wsr Itgs 
JiiefpitiifiiiitotaJti, fiMllj, i, rpesti tie 
ifSHf rsktiriip IteHjjffiW illwtei tliuii sip^ ^ 

inplnB^iflallttaflliK Jifflcsltiwil 
»ipifl« isy«li|tJsrii|lMlHipriiofalliiW 
tii fi titer lip iiJfFi start lop,- 1 lilritolyi i 
aijEforHltlijIliiiiit piiiititlj;ftrisim! 
tlfBiittppteielUiriffiiiiit liMi 
JJiii iyil f», lit there « ieial ciiteit catf ries iere 
lit ilmi igreei k k m, ki mi fltepriii ilere rslJtlielj 
littl! tii.i \m illocitei, if tie i iierije Jiffereice! is im 
iiiC(5taljriltlijll|iBete^ tlaslSite 
inip'tiiiijhmlesstlilirtn'iipltA Its lit 
wliiZirKJiiJiiiri I, M iJliareitypht 
Irefie » if tie 'iMpeits'letiffl tie ii if c^^ 
iitimMiteitiiite, iHijistlereiereiflarpiferajs 



llefciKifcHiiiHiirfortlffi 
apfeirsJtitelirprtliHtefirllsotlerc1iss{s,rrt 
Iftafitteltewfiltta 'litfiiertlis,. CiiJ. 
Erif ill of til ilasies, tlsreiere imsl saplK if liKitpiitii 
»lili ifl stier im pieiss of1le reiJiflj friji iais ^ kkM If 
tletfarktitlftletilsrinitsfsi, himm 
reflettJiierifsoBrcsifmr, IiillMseifiefter. 
,,,,toii|strjt|Kfortletii4tJira!, ..(leatlff lip m tii 



rastleiltlpletiilBistrateiiiiisiierisriijn 
till iSiMi 5f error k to ctif !tr3te| JiffersKs is mfirei 
MttnoariofefrirHiii OjssSlieSiltatrJtss 
Wi^lfficiltj. S5tstlat,istlistii|tleMiicolisJiij£ 
itEMilteitlUitltleeiptloiofprilitiEa^^^^^^^ 

tatjatetootatlesiofgMiffltsjttttep'esj, 
6i"J?forcili S(3jiiites)isijitetepgiltltle 
Mmsptiij ill fir till [{l^Jiitffij, liiisiijeolmr 

loj (llicl BSSi fOtE jlloolj 

tiifrelffiiofteit,iiiitlEtej[l 
Jiitrjtaitletiliieritesttlijoriiijsiiit 



IlHirlawsiHliiitiiltateltofejiijlofr 

i|Hfiitryctio»)iisitte;tlitiMtyiEitn'»tle» 

trttigetireorles! siiilarirtiftiiill 



SHiij stilts iitliniesiiclsyjtotaltiallg^^ 
jitetainlaf firtttiWw, 

lmteBtcatfriKfitiiisjpirtiilljipsjtl(sset--tle 
lit of tile iHf 01 iiteppis It ii[«*t of tie lii I 
tleitlertiteprliL fitlerimiaiermijofleMtejtijteoWto 

CM errors iioi irireiiialcateprles^ 

fortotiltiBalkiteitireiiirelitiielj large IffereicB 
litiMirKofiiBifoii Itetlit III allocatti till' 



Siij iter cieit latepries, coiiig stratef f ferera i lof r 
^■ilisffKt, itleeiptioftlassl 
9lisiiii(l[raio(iErat 



adjosted allocated tie from teacher logs ws lore hlghly correlated 
witii ingaged tine from direct oliserwtion. For eicli of thisi classes ttie 
iproviMt was sybstantiil, Howsvir In tso of the riiiining three 
classis (1 and 5) the decrease in the relationship broyght about by the 
adjystment procedure was also substantial. So, in this sample, the 
characteristics of the allocated tlim from teacher logs weri improved 
in three of the classes byt not improved in the other three by the 
adjustment procedyri, 

Tables 3,J through 3.12 present comparative data on observer and 
teacher logs of mathematics instruction, Each table presents InfonHtion 
on one tiacher, The tables are Identical in fonnat. These tables deal 
only with the content inforaation of the logs. 

The tables are based on teacher logs, observer logs, and direct 
observation Information for days when all three sources were available 
for a given class, Table 3.12, describing the log characteristics for 
Class 6, is based on data from six days of instruction. The tables for 
the other five classes are each based on inforaation from sesfen days of 
instruction. 

The rm of each table are labeled by general content category. 
The fi5t 10 rows represent the 10 general content categories, row eleven 
is a subtotal for general content categories 6 through 10, and raw 
twelve shows total time in mathematics instryction (the m over general 
content categories 1 through 10), The entries in column H are allocated 
times from the teacher logs. .Column C presents allocated time from the 
observer logs, Inforaation in all general content categories was included 
for columns h and C, since the logs provided this inforaation. Coluw ■ 
A and C provide the basic comparison for allocated time. Column D presents 
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Mathemities 

mi 1 



Oininl 




id Sllccattd 
LOgij 


Tirg Ffflr 


^ insscid Tine 






Oifff-eflMS 
fbf Wi/fs 
A ifid t 


for cM«,:ns 
i and D 




55 

(11) 


n 

[1] 


51 
(^) 


26 

(§) 






6 

(11)- 


10 
(7) 


2 ^dciticn kith 


0 

(0) 


0 

(0) 


0 

(0) 


(1) 


r 


iUU .uu 


u 

(0) 


(1) 




Jill 

0 

(0) 


23 32 


18 
(/) 


.33 


-.25 


21 

(10) 


9 








(8) 


4 Subtraction filth 


0 

(0) 


0 

fo) 


0 

(O) 






0 

(0) 


0 

(0) 




0 

(0) 


0 

(0) 


30 
(0) 


23 

(10) 


— - 


nn nn 


jO 
(0) 


(10) 




44 

(2) 




9 

(3) 




in 




35 
(3) 




' neslUrciiignt 


0 

(0) 




0 

(0) 


— ^ 






0 

(0) 






0 

(0) 




0 

(0) 




— - --^ 




0 

(0) ■ 




A Kord 


41 

. (2) 




21 
(31 




,59 




31 

M 




'8 Other 


0 

(0) 




84 




00 

iUU 








6 thraygh 1(1 


86 
(4) 


38 

m 


114 
(19) 


3? 
(7) 


J8 


.25 


31 
(9) 


10 

(7) 


Total Hnhc^tks 
10 toinid . 


194 
(23) 


84 

m 


227 

m 


104 
(16) 


.35 ■ 


-.54 ^.25 


39 

(1/) 


31 

(23) ; 



logi m iljocacd time frefii gborvir losi. 



' 1 ■■ Wl(il« M'tdi km „m. t! lite WiMtlin l,| ft,,, ,irlKi «i dil,. «, 



Table 3.8 



Mataatics 

Hiios, standard deviitlsf!!, correlitlaM aiiii aysfi^i dlffirtHGis far elju 2 sn allOHtid i\H frsi mkf Isgi, idjuitld 
illscittd tlini frsffl tiichir logi, illscittd tima 1m observer logs, and inpgid tldii frsiii dirset e&iirvnion. TNii diu 
ari iiMed ovir isven dajfS flf Initryetlen for *(Mch all three saureei of tlmi Infonsition wiri iyillibli, (f| ■ IB) 



Cl AMi 



65 





M 


s ^ • 


c 


0 . 












Gtnifii 
Urim 




i-p, lisi^ jFfoa 
if liiciiir 
Lflji) 


' Tiri fro; 


1 

hm Direct 
Obiir^itisn 


hi 




'"id 


Oiffirir.ts^ 

__hmt 


b ind 0 




51 

(12) 


25 
(6) 


0 

(0) 


(a) 


.00 


.29 


.11 


, 51 


20 




0 

(0) 


0 

(0) 


0 

(0) 


0 

• (0) 


__c 






0 

(0) 


0 

(01 


J liibtraction No 


m 


21 
(8) 


5 

(1) 


7 : 
(4) 


%01 


.59 


.51 


51 

(15)^ 


20 
(6) 




0 

(0) 


0 

(0) 


0 

(0) 


0 

(0) 








0 

(0) 


0 

(0) _ 


r PUCI 
" Jslui . 


101 

(24) 


49 
(12) 


209 
(4?) 


1/6 
(45) 


.79 


.81 


.75 


109 
(32) 


127 


instil!] 


42 
(9) 




38 

m 




.66 






7 

. (12) 




? MtllyrefiiQnt 


0 

(0) 




0 

(0) 




mm 






0 

(0) 






0 

(0) 




0 

M 










0 






0 

(0) 




0 

(0) 




= = 






0 

(0) 






0 

(0) 




0 

(0) 










0 

(0) 




b throygh ID 

Cofi'iylnia 


42 
(9) 


21 
(5) 


38 

m 


0 

(0) 


.66 


.00 


.00 


7 

(12) 


21 


Clti^prtiS 1 ItirDugh 


24i 
(49) 


121 

m 


252 
(55) 


189 
(^1) 


.84 


.85 


.70 


24 
(18) 


68 

(37)^ 



Thi intrlil In tfiis eQlui!)/! in ayerige dlffErinctl wltoyt n^iri for llgri hfXmn lllggiUd i\m fm tiadiHr 
logs and illotitpd i\m fm ofeimif k^h 



The inlrlii !ii iliii ttim m mrm dlffirint^ Hlth"i'l rmi ferilgn kmm idjystQd alliiytd Uf.?^ 
- Ifrsfi liiehti logs) and oh^^^^ 



, ' ' . Hathematics - . 

""V^^^^^^f ' f ^^l^^i^"^ ^^snp differincii fop cUis 3 on allocatsd tlmi fm teaehir logi, idjustid 
81 located tine fr§n tiiehir logi, alloated tin to observer logs, and engaged time frsm direct ebiiryatlon, Thiie dati 
an sunmed ov«r ievin daj^i ef 1nitru£t1on for which all three loyrces of tine infomtlon t^ere-ivalUbli. H • 20 



D 



Centist 

_ Citi^srii 


Ti'ui 


Ilmi (Frei 
Up) : 


^1 (^(.SU^w 

Lop ■ 


Engjgid Ticig.,. 
■ FfQin Direct 
Dbsefvation 


hi' 


''ad 




for collnns , fgr col 05 
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The teadier ratings of student attentiveniss are 'describid in siction 11, 

Thi adjusted teacher ratings of student attentivetiiss were obtained by multiplyini thi 
^^acher ratings of student attentivenesOy a: aifferent constant for eicli class. "Tfie 
lean of the MJusteiratinRS equal the' mean claas engagiMt determined by one day of 
observation in each class, as described in section II. 

The observed aipgenient rate was calculated by taking the ratio for each student of 
engaged tii^in reading (direct observation) and allocated time in reading (observer 
logs), 3S described in section II. 

Standard deviations are shown in parentheses. . , 
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correlatlon between the adjusted teachir ratings of student attentiveness 
and the observed engagement rates varied considerably for the six classes. 
Since the number of students within classes was small, only one of these 
correlations (Class 3) appeared to be Inordinately large. Thus with the 
exception of Class 3, the adjusted teacher ratings did not correlate 
within classes consistently and positively with the observed engagement 
rates. When all studsnts were pooled, the correlation was positive and 
■moderate in size. Since this correlation coefficient is affected by the 
fairly large between-class differences, its size Is not surprising. 
Furthermore, the between-class component of the pooled correlation of 
adjusted teacher ratings with observed engagement rates is attributable 
to the adjustment alone (which was based on a single, day of observation/ 
as discussed previously). The between-class component Is iiot attributable 
to the teacher ratings themselves, because the mean of the adjusted 
teacher ratings for a given class 1s independent of the teacher ratings' 
for that class. 

On the other hand, the correlat1o# between the adjusted teacher 
ratings of student attentiveness and academic status^ were all positive 
and large. This could be interpreted In several ways. It may be tfiat 
aptitude and student attentiveness were strongly related; or more likely, . 
that tha teachers' ratings of student attentiveness were strongly biased 
by teacher perceptions of student aptitude. Note that the within-class 
correlations in the table were not affected by the adjustment procedure, ' : 
since the adjustment coefficient was a constant within a given class. 



Academ a measure of overal 1 student achiVvement in reading. 

This, may be consi dered as a measure of student aptitude for school 
achievement. : . " : 



Therefore, the within-class correlations for adjusted teacher ratings 
with academic status are independent of the adjustment factor and attri- 
butable entirely to the unadjusted teacher ratings. The observed 
engagement rates, on the other hand, were derived without reference to 
student academic status. This table points out that teacher ratings of 
student attenti veness were more strongly related to academic status than 
to-observed engagement rates. Note that the observed engagement rates 
were lower in correlation with academic status. 

Table 3.14 presents information on student engagement during math- 
ematics instruction. Columns A, B, and C, of. this table show the means 
and standard deviations for different engagement indices. The average 
teacher ratings of student attenti veness were, in every case, h.igher than 
either of the averages of the indices based on independent observation 
procedures. With the exception of Classes 2 and 3, there was close 
agreement, between columns B and C for both means and standard deviations. 
(Remember that the observation procedure underlying the adjustjTient for 
column B was conducted on reading instruction rather than mathematics 
instruction; this may make comparisons between the columns hazardous.) 
The correlation between the adjusted teacher ratings of student attentive 
ness and the observed engagement rates fluctuated around zero for the 
six classes. Since the number of students within classes was smal 1 .none 
of, these correlations appeared to be inordinately large. Thus, the 
adjusted teacher ratings did not correlate within classes with the 
observed engagement rates. When all students were pooled, the correla- 
tion was low and positive. As with the analyses for reading, the 
between-class component of this pooled correlation is independent of the 
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- Ih6 uachar of student attinttaMM .re described In aettion II, 
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The observed engageient rite was calculated by taking the ratln fn. ...j, a . , ' , 
tiir.e in matheiatics (direct observetinni .n/ i !V ""^'"^ "^''"S^i^'^ 

as discribed in "action II. '^''''^^^'"^ ^^^^^^t^d tm in latheiatics (obsamr logs) 

.Standard aevlations. are ahown in parentheses. 
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unadjusted teacher ratings and is attributable entirely to the adjustinent 
factor. 

The adjusted teacher ratings of student attentiveness and acadenilc 
status are the same variables in both the reading and the mathematics 
analyses. Therefore, the correlations between adjusted teacher ratings 
and acadeinic status were all positive and large for mathematics just as 
for reading. However, the observed engagement rates for mathematics 
showed even lower correlations with acader,wC status than did the observed 
rates for reading. These correlations for mathematics were essentially 
zero. Hence, the mathematics data provide confirmation of the conclusion 
that teacher ratings of student attentiveness were more strongly related 
to academic status than to dbserved engagement rates, while observed 
engagement rates were unrelated to academic status. 

These findings, support the conclusion that teacher ratings of student 
engagement do not provide useful data for analyses of instructional time 
because these ratings are strongly infl uenced by teacher perceptions of 
student aptitude. Therefore, analyses relating instructional .time to 
Student learning outcomes did not use teacher ratings of student attentive^ 
ness. However, the'observed engagement rates included in the data 
discussed above were used in analyses of instructionaT time and student 
learning to adjust teacher records of allocated instructional time. 
Brief discussion of some of these analyses is presented below. 

Predictive Validity - ■ : 

It is not the purpose of this paper to analyze the relationship 
between instructional time and .student learning\ "Therefore, complete data 
fronr regression analyses conducted with time and learning data will: not 
be presented or discussed here... Nevertheless,, notatyopTof a few of the. . 
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findings of these regression analyses will be made here as a means of 
examining the relative validity of different sources of data on instruc- 
tional time in terms of their predictive relationships to student learning 

The foregoing discussion Indicated that teacher ratings of student 
engagement are probably more closely related to student aptitude than 
they are to student engagement itsel f. However, estimates of student 
engagement rates based on the ratio of observed engaged time to observed 
allocated time are potentially useful for the purpose of adjusting 
teacher records of allocated instructional time. These observed engage- 
ment rates were obtained over_ the shorter (two-week) OA-OB period of 
the study. The teacher records of .allocated time for the longer (eight- 
week) A-B period of the study were adjusted using these observed 
engagement rates. The adjusted teacher records were used in regression 
analyses relating instructional time to student learning. Comparisons 
between analyses using adjusted teacher records of allocated time and 
analyses using unadjusted teacher records provide some indication of the 
utility of observed engagement rates as a means of Improving teacher 
records of allocated time. 

These analyses regressed student posttest scores on three variables- 
the student's pretest score, his entering academic status, and his 
instructional time in the related content area. The unique variance 
accounted for by the instructional time variable was calculated for each 
analysis. Comparisons of analvss using adjusted and unadjusted teacher 
records of allocated Instructional time indicated that a greater percentage 
of unique variance is accounted for by records of Instructional time that 
have been adjusted using observed engagement rates. Inconsistent results 
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were obtained for'thi differant subtests in reading. However, adjusted 
records of Instructional time accounted for more variance in total 
reading scores in both analyses conducted on these scores (one with all 
subjects pooled and one with subjects pooled within each class). The 
adjusted instructionar time accounted for more variance in five out of 
the six regression analyses conducted with teacher records of instruc- 
tional time in mathematics. 

It should be noted that the utility of the observed engagemer^t 
adjustments for analyses with subjects pooled within each class, ih addi- 
tion to analyses with all subjects pooled, provides some indication that 
the engagement adjustments accounted for individual differences between 
students within classes as well as differences between classes 1n terms 
of engagenient rates. 

These ^findings suggest' that 'teacher records of instructional time 
"'"are more strongly rel ated to student learning when they are adjusted 
using observed student engagement rates. The primary advantage of using 
the adjusted records of allocated time, rather than simply observing 
engaged time directly, is that the adjusted records provide an estimate 
of engaged Instructional time over longer periods of time (such as the 
eight-week A-B period), where the more expensive procedure of direct 
observation Is required only for some shorter period during which engage- 
i.ient rates are observed (such as the two-week OA-OB period). 
■ ,^ It would also be desirable' to examine the. relative val idlty of teache 
records of Instructional time (either adjusted or unadjuspff) and observed 
engaged instructional time, in terms of their predictive relationships to 
.student learning. Unfortunately, however, the data set considered here 
does not lend itself to this comparison. The teacher records of allocated 
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time were obtained over an eight-week period, whereas the obseryation of 
engaged time was obtained over only a two-week period* It was found that 
very Itttle student learning occurred over the shorter two-week period, 
Therefore, there was little to be predicted with observed engaged time. 
Despite this difficulty, it is possible to make some rather rough 
comparisons between teacher records of allocated time and observed engaged 
time for instructional time and student learning In one mathematics sub- 
test, that for place value/ This was the only subtest in either reading 
or mathematics where any student learnling was detected over the two-week 
period (except one reading subtest where the average stu^lent gain score 
was much less than one standard deviation)* Observed engaged time In 
place value accounted for 10.8 percent of unique variance on student 
posttest scores in place value (subjects pooled). Adjusted teacher records 
of allocated time accounted for 6,4 percent, while unadjusted allocated 
time accounted for less than one percent of unique posttest variance. 
However, the results for the teacher records may be due to inaccurate 
record-keeping by teachers of their instruction related to place value. 
When several related mathematics content categories were combined, adjusted 
teacher records accounted for 16.9 percent of the posttest variance for 
place value, while the unadjusted records accounted for 7.8 percent 0 
this variance. The same combination of categories for observed engaged 
^ , ; time resulted in only 3. T percent of unique variance accounted for by time, 
Therefore, these data support the conclusion that teacher records of in- 
structional time are comparable to observed 'engaged time, Thisvappears 
to be particularly true when the teacher records are adjusted with 
/observed student engagement rates and when combinations of teacher record 
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categories are used to compensate for possible 1naccuraf.ies 1n these 
records, ""■ ' 

It should be noted that the conclusions above are tentative, and 
Should be treated with some degree of scepticism. The data discussed 
include only one fifteen Item subtest. Furthermore, the periods of 
instruction compared (the eight-week A-B period and the two-week OA-OB 
period) are quite diss., 'lar in length. Therefore, these results are 
only preliminary suggestions of what might be expected of teacher records 
In relationship to direct observation. Neyertheless, the economical 
researcher may well be encouraged to use teacher records of allocated 
instructional time, adjusted using observed student engagement rates. 



IV SUf^lARY AiND CONCLUSIONS 

Alttrnatlve procedures have been presented for coll ecting Instructional 
time data. These include the use of teachers and the use of observers as 
alternative sources of data, as well as allocated Instructional time and 
engaged Instructional time as alternative forms for the data* Alternative 
procedures for estimating student rates of engagement have also been 
presented. Instrumentation and procedures for using that instrumentation 
have'been described in some detail* 

Data have been presented and discussed as a means of examining the 
relative utility of these various procedures. Inter-observer reliability 
data were examined for the observation of engaged Instructional time* It 
was found that engaged Instructional time 1n reading and mathematics 
content areas can be observed at a level of reliability that is suitable 
for most research purposes. 

Next* data were presented comparing teachers and observers as alter- 
native data sources for the same Instructional time. In general, it was 
found that data on ajjocate^ instructional time obtained from teachers 
shows reasonably high positive correlations with both allocated and 
engaged timeobtained from observers. Estimates of student rates of 
engagement, obtained from teachers , were used to adjust teacher records 
of allocated time, thereby providing teacher records of engaged time. It 
was founc). that teacher records of engaged time in reading instruction 
were generally no more highly correlated with observational data on :V 
engaged lime than were teacher records of alloaated time. Moreov^rv^ 
records of engaged time in mathematics instruction were generally lower iri 



correlation with observational data on engagad time than were teacher 

records of anocated time. Therefore, It may be concluded that teacher 
estimates of student engagement rates are not useful for the purpose of 
obtaining records of engaged iristructional time from teachers. It should 
be noted that this conclusion treats the observational data on engaged 
time as the criterion for the validity of the data from teachers. The 
fact that extensive training was conducted with the observers and that 
acceptable inter-observer reliability was obtained does support the use of 
the observational data as the criterion for engaged instructional time. 
Howeveri further analyses.were„aliO-conducted in examination of the 
validity (or lack thereof) of the teacher estimates of student engagement 
rates. 

Intercorrelations were determined for teacher estimates of engage- 
ment rates, observer estimates of engagement rates, and academic status, 
a general measure of student achievement In reading. It was found that 
the teacher estimates of engagement were more highly .correlated with 
academic status than with observer estimates of engagement. The observer 
estimates of engagement were obtained separately for reading Instruction 
and for mathematics Instruction. The observer estimates for reading ■ 
showed a lav positive correlation with icademic status, lower than that 
for the teacher estimates. The observer estimates for mathematics in- 
struction showed essentially no correlation (zero correlatiori) with 
academic status. 

These findings support the previous conclusion that the teacher 
estimates of student engagement rates were not as valid as those obtained 
by pbservatlon. The measure of academic status can be seen as a general 
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indication of student aptitude for school achievement* This would suggest 
that the teacher ratings of student engagement were strongly influenced 
by teacher perceptions of student aptitude or level of achievement. The 
comparatively low positive correlation between academic status and observer 
estimates of engagement in reading^ however, can be explained as a function 
of the effect of engagement in reading upon achievement in reading. This 
interpretation is supported by the lack of correlation between academic 
status (reading achievement) and observer estimates of engagement in math- 
ematics. One would not expect engagement in mathematics instruction to 
have an effect upon reading achievement* Hence, it appears that teachers 
have difficulty estimating student engagement rates independentiy of 
student aptitude for academic achievement. Observer estimates of engage- 
ment are more likely to be valid. 

There was also some discussion of the relative validity of teacher 
and observer instructional time data in terns of predicting student 
learning outcomes. The available data do not warrant rTiore than tentative 
conclusions. Nevertheless* there was some indication that teacher and 
^ observer sources of instructional time data are comparable in terms of 
their association with student learning outcomes* In addition, the teacher 
records of. allocated instructional time seemed to be more highly associated 
with student learning when they were adjusted using observed engagement 
: - - rates and when combinations of instructional time categories were used to 

. compensate for possible miscategonzatlon of time by teachers 
i:-: This body of data indicates that teacher records of allocated time 
provide a relatively economical source of Instructional time data. : 
Furthenfiore, these records of allocated time can be adjusted using observed 
estimates of student engagement rates, thereby providing data on engaged 
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Instructional time. The observed engagement rates obtained here were based 
upon two weeks of observation. However, it is Hkely that vewer days of 
observation, sampled at different points throughout an acadenic term» 
would provide adequate estimates of engagement more economically. 

It is hoped that these findings will provide some guidance toward 
optimal procedures for conecting instructional time data. 
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Appendix A 



Reading Content Categories 
and 

Examples of Teacher Logs 
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Spedfic Content Categories for Grade 2 Reading Instruction 



Specific 
Content 
Category 
Number 



Specific Content 
Category Name 



General 
Content 
Category 
Number 



Gbservation 
Content 
Category 
Number 



1 

2 
3 

4 
5 

fi 

7 
8 

9 

10 

n 

58 
14 



Decodj'ng 

Sirigle consonants 
Consonant blends and digraphs 
Variant consonants (c.g) 



Vowels - short 

Vowels' - final e pattern ■ 

Vowels - dIgrap'R's 

Vowels - dipthorigs 

Vowels - vowels + r (car) 

Complex, mul ti-syl labic 

Silent letters 

Sound substitution tasks 

Spel 1 ing 

Other decoding 



long vowels 



2 
2 
2 

2 
1 
1 
2 
Z 
2 
2 
2 
2 
2 



2 
2 
2 

2 
1 
1 

2 
? 
Z 
2 
2 
2 
2 



15 
16 

1.7 
T8 

19 

20 



21 
22 
23 
24 
25 
26 
27 



28 
29 
30 
31 

32- 
33 
34 
35 



Context Clues 

Choosing wordfs)wh1ch fit gram, context 3 

Choosing word(s)which make best sense 3 

(semantic appropriateness) 

Choosing correct form of word 3 

Choosing word with correct initial cons. 3 

Choosing correct pronoun 3 

Other context clues 3 

Word Structure 

Compound words 4 

Identification of root words 5 

Prefixes - meaning and use 5 

Suffixes - meaning and use 5 

Contractions 5 

Syl 1 abl as P, 

Other word strycture 5 

Word MearriM 

Synonyms 6 

Antonyms 6 

Vocabulary building 6 

Pronoun reference 6 

Multi-meaning words in context 6 

Unfami 1 lar words iin context 6 

Figurative language 6 

Other word meaning. 6 



:j 
4 
4 
4 
4 
4 
4 



5 

B 
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CQfnprehension 



36 Understanding event detail 7 5 

37 Understanding description 7 5 

38 Understanding relationships 7 5 

39 Understandinig main idea 7 5 

40 Literal recall 7 5 

41 ^ Translation of ideas 7 5 

42 Synthesis of Ideas, inference 7 5 

43 Going beyond the text , prediction 7 5 

44 ^ Recagnliing facts and opinions 7 5 

45 General comprehension 7 5 

46 Understanding directions 7 5 

47 Picture interpretation to aid comprehension 7 5 

51 Understanding signs 7 5 

52 Understanding letters 7 5 

Areas Ret a ted to Readi ng 

48 Dictionary skflls 

49 Reference sources in books (table of 0 7 

contents.p fndeXj^ glossary) 

50 Choosing reference sources {dictionary, S 7 

encyclopedia I card catalog) 

53 Understand iiig Maps 8 7 

54 Understanding Gi'^aphs 8 7 
59 Graninar . 8 7 
50 Creative writing .87 

Readin g Practice 

12 Sight words 9 6 

13 Automaticity of v^ord recognition 9 6 

55 Reading for different purposes 9 6 

56 Oral reading 9 6 

57 Reading for enjoyment 9^ 6 

61 Reading in content areas 9 6 

62 Si lent reading 9 6 
57 Music (reading lyrics) 9 0 

Miscel laneous & 

63 Listening (to story or tapes) 10 

64 Penmanship and copying 10 - 

65 Standardized tests 10 

66 Foreign language 10 - 
68 Dramatics (plays , choral reading,,.) 10 
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General 


Lontent uatfigones tor braae rd Keaaing 


instruction 


General 




Uuservo 1 1 on 


Content 




LQnsent 


Category 


Genera r content 


Category 


Number 


Category Name 


^ 1 ^ i rift P% ^ 

PfUFnoei 


1 


Long vowels 


1 (RL) 


2 


Other decoding 


2 (RD) 


3 


Context cities 




4 


Compound words 


3 (RC) 


5 


Other word structure 


4 (RS), 


6 


Word meaning 


5 (RM)° 


7 


Comprehension 


5 (RM)a 


8 


Areas related to reading 


7 (RO) 


9 


Reading practice 


6 (RP) 


10 


Mi scell aneous 





^ Observatidn content category 5 included general content 
categories 3, 6 and 7, 
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READING GLOSSARY 

I, DECODING (Knowledge and use of letter-sound correspondence) 

sec 1 Single consonants - . 

Sounds of single consonants in any position in a word 
Examples : b, c, d, . . , 

sec 2 Consonant blends and digraphs 

Blends include st, bl, tr, . . , 
Digraphs Include ch, sh, th, wh. 

sec 3 Variant consonants 

A comparison of several sounds possible for a single consonant 
Examples : '^c" in cat vs city, »'g" 1n £oat vs £iant 

sec ^ Vowel - short 

Regular short sound of a, e, i, o* and u 

sec 5 Vowel ' final e pattern 

Long voivel sound when word ends with as in rope 

sec 6 Vowel digraDhs 

Include ee, ea, ai, oa, and ay " 

sec 7 Vowel diDthongs 

Include 01, 00, ou, oy, au, and aw 

sec 8 Vowel pi us r 

Vowel sound modified by following consonant r 
Examples: ar, er, ir, or, ur, air, ear 

sec & ComDleXs multi-synabic 

Decoding of mul ti- syllabic words, includes internal patternst 
synable influence on vowel decoding 

see 10 Silent consonants . - . . 

Letters which are not sounded in a word 
Examples: comb, ^nit 

sec n Sound substitution tasks 

Substituting one sound for another to create a new word. 
LxamDle: fan, ^an, p, pan 

sec 1- Sight words 

Recognition of common words, especially function words (the, of, to, 
would, could, were) and words with i rregular .spelling (ar^, come, put 

sec Ij Automat i city of word recognition 

Practice to improve speed of word recognition, so that tho [irnce^.s 
becnines automat ''c. 

:i\ CO^'TEXT CLUES 

Context clues involve usino the context of a phrase, sentence,: or story 
to help identify a word or to predict a missing part. Different types 



of context clues emphasize different aspects of the linguistic context 
or of the word to be Identified, 

sec 15 Choosing wQrd(s) which fit the grammatical context. 
Father is sleeping the bed, 

night 
in 

warm 

sec 16 Choosing the word(s) which make best sense in the blank. 

The . lives in the royal palace with her father* 

pri ncess 
pri nee 
sister 



sec 17 Choosing the correct form of a word. 

Both of the _______ a^e asleep. 

baby 

babying 

babies 



sec 18 Choosing the word with the correct initial consonant. 
Don ' t the milk, 

sifl^^^ 
spill 
still 

sec 19 Choosing correct pronoun. 

John dropped his book and then picked up. 

them 
it 

him ' 

III.-- WORD STRUCTURE 

see 21 ConiDOunds 

Wo'^ds formed by combining two smaller words - "mailbox" 

see 22 Identification of root words 

Recrjgnizing the root word in a derived fonn ^ ''playing" root ^' play 

sec 23 Prefixes - 

Include re- i un- ^ dis-, pre-, . . * 

sec 24 Suffixes 

Include grammatical endings like -ed, and -ing and other i^uffixes 
like -ly, -ful, -nesSs -less . - 

sec 25 Contractions 

do not - don ' t 

sec ?6 Syllablf?'. - sepiiration of a word into sound units prnamblt' - \)rv m hit' 

lOt 
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IV, WORD MEANING 

sec 28 Identifying words with similar meanings - quick = fast 

sec 29 Antonyms 

Identifying words with opposite meanings - large vs, small 

sec 30 Vocabulary building 

Learning word meanings 

sec 31 Pronoun reference 

Identifying the referent of a pronoun. 
*'John v/ashed his car J' his^John's ' 

sec 32 Multi-meaning words in context 

Identifying the specific meaning of a word in a particular 
context. 

I cut mv hand on a piece of paper, 

a. ' paVt "^bf ^ a^ clock : 
b* pert of a person 
c. give something 

sec 33 Unfamiliar words .in context 

Deducing the meaning of an unfamiliar word through its use in contuKt. 
The car was so badly entrenched in the mud that we had to Cdll a 
tw- truck . 

a . stuck 

b. built 

c . di rty 

sec 34 Fiqurative language 

Reconnizing the meaning of a word or phrase used in a nonliteral 
sense^ including similet fnetaphors and idiomatic expressions. 
The soldier fought J j^ke a ti ger to protect his home. 

a. in a striped uniform 

b. with sharp claws 

c. bravely and fiercely 

Oh, how Peter wished he could whistle! Peter saw his friend Som , 
Dlayinp with a dog, Wheniver Sam whistled, the dog ran straight tu hinu 
Peter v/ished he could do that trick with his own dog, Willie. \'i^\.vf Lt it^u 
and tried to whistle, but he just couldn't. 

Peter went into his house and put on his father's old hat, tu inake 
nimself feel more grown-up* He looked into the mirror to practiccf 
. whistling. Still no whistle! 

The next day Peter went outside to play. He sat on the front stops 
and tried to whistle. Then Peter saw his dog coming. Quick as a wink, 
^eter hid behind the stairs , He wanted to surprise Willie with a wliistlu. 
feter puffed un his cheeks. He blew and blew arid blew. Suddunly, out. 
cdiiio a real whistle. W11 1 ie stopped and looked around to sou who was - 
. MKikinci the noise. 

"It's IMP,- Peter shouted. He jumped out from behind tlie sttjiru. 
Willie raceti strtiigtit up to. hi in. 

:The following illustrations refer to the story above. 



V, COMPREHENSION 

sec 36 Understanding event detail. What did Peter put on? 

sec 37 Understanding description - Where did Peter hide? 

How did Peter feel at the end of the story 

sec 38 Understanding relationships - What happened first? 

Why did Willie stop and look around? 

sec 3S Understanding the main idea = What 1s the story mostly about? 

What lesson can we learn froni the story? 

sec 40 Literal recall - recall of infomiation exactly as stated in the story. 
What did Peter wish he could do? 

a. have a dog 

b. whistle . 

c. go to school , 

SQC 41 Translation of ideas 

Recognizing ideas stated in different words; ability to paraphrase; 
recall of Infonnatlon when Ideas are restated. 

What haDpened when Sam whistled? 

„ a. Peter went over to see Sam 

b. A dog went over to see Sam 

c. Peter whistled too 

sec 42 Synthesis of ideas, Inference 

Ability to integrate information from di fferent points in a text; 
understanding ideas directly implied by a text. 
What trick did Peter want to do with his dog? 

a, teach Willie to whistle 

b, put an old hat on WilUe 

c, whistle to call Willie 

sec 43 Going beyond the texti prediction 

Relating the text to one's own knowledge and experience; supplying 
fron; experience information not directly given in a text. Includes 
predicting what might come next in a story, 
Ho»v did Peter feel when Willie came running? 
a. happy 

b * scared . 
c. mad 

sec 44 Recognizing facts and opinions 

Evaluating statements and the basis for their acceptance. 
Included evaluating the qualifications of a speaker. 
Which of the following Is a fact rather than an opinion? 

a. The Etruscans bui 1 t ci t1 es long agoV 

b* The jewelry made by the Etruscans was thu niusl 

beautiful ever made, 
c/ Historians do not know as much as archeulofjists do. 
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sec 45 General Comprehension 

snent reading or general reading practices where comprehension 
involves a mixture of the facets above: (Please use one or more 
the specific categories, if possible.) 
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Example: Attendance/Group Composition Record 



READINS) MATH (cir-cle one) Teacher No. 3 Grade 2 



1 

1 student's Name 


Group 


Week of October 27-31, 1975 




3 


M 


T 


U 


Th 


r 


1. ID tt 239 












2. 10 # 240 


2 










3. ID § 241 


2 


Absent 










£. ID # 242 


3 












5. ID # 243 


3 . 






Absent 






6. ID a 247 


2 












7. ID # 251 


3 










— --^ 4i4 ^^^^^ — 


8. ID # 252 


2 








u 

^ - & ^ 


U 


9. ID a 253 


2 








Oi 


dj 


10. ID ^ 254 


3 










IT. ID # 255 


3 












12. ID If 256 


2 












13. ID # 257 


2 






Absent 






14. ID # 258 




' 




- ■ 




— 


15. ID a 259 


2 












16. ID 260 


3 










17. ID ^ 262 


3 












1 18. ID # 263 














19. in ii 264 


2 












20. in # 265 


3 












21. ID # 266 


3 












22. 














rfr. 




























—. ^ 














26. 














aL 














1 28. 














i 29. 














3C. 




























\ 












' 33. 














\ 34. 
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Appandlx B 



Mathimati cs Content Categories 
and 

Examples of Teacher Logs 
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General and Specific Content Categories for 
Gradi 2 MathOTatlcs Instruction 



Specific Content General Content 

Category Number Category Name Category Number 



Computation 

1 Addition without regrouping 1 

2 Addition with regrouping 2 
3-. Subtraction without regrouping 3 

4 Subtraction with regrouping 4 

5 Multiplication - with both factors being 9 

less than 10 

6 Speed tests/timed drill in addition 1 

7 Speed tests/timed drill in subtraction 3 

8 Number sentences involving equalities 6 

and inequalities 

9 Family of facts/renaming numerals 1,3* 

equation form 

10 Number patterns/sequences ,6 

25 Missing addends "both In addition and 153* 

subtraction 

11 Other - computation** 10 

^ Concepts 

12 Numerals and ordinals 6 

13 - PTace-valuewith-compact or expanded 5 

notation 

14 Fractions involving sets^ regionSi or v 9 

lines (1/4,1/3,1/2.2/3,3/4) 

15 Properties (associativei commutativei 6 

and identity elements) 

16 Associative property with expanded 5,6* 

notation 

17 Money 9 

18 Linear measurements 7 

19 Measurement ccncspts: order^ capacity, 7 

conservation of length 

20 , Seometrlc figures: '8 

21 Curves and points 8 

26 Developmental activities 6 

22 Other - concepts** 10 
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Specific Content 
Category Number 



Category Name 



General Content 
Category Number 



Applications 



23 
27 
24 



Word problsns 
Standardized tests 
Other - applications** 



9 

10 
10 



*Specific content categories 9,16, and 25 are logically related to two general 
content categories. In each case time in a specific content category was 
divided equally and assigned to the appropriate general content categories. 

**t1me in specific categories 11 ,22524 was assigned to general content category 
10 if it was not clear that the event could be ass ?gned to general content 
categories 1-9* ^ 
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Geniril Content Categoriii 



General Conttnt Observation Content 

Category Number Category Name Category Number 



1 


Addition without rtgrouping 


1 


2 


Addition With 


regrouping - 


.2 


3 


Subtraction without regrouping 


3 


4 


Subtraction' with regrouping 


4 


S 


Place value 




5 


6 


Number system 
Measurement 


) 




7 


) 




8 


Geometry 


) 


6 


9 


.Word problems 


) 




10 


Other 







ERIC 



Glossary: Siliuted Specific Contint Categories 



sec 8 Number sentencis: equalities and Inequalities 

Determining what sign 1s missing in an equation or number 
" sentence. 
Primay 
also 



sec 10 



sec 1 5 



irlly involving the signs of^- , ^ , and — . But may 
Involve + and * 

Examples: 



5^4 
2 + 1 ©3 
3©4^ 7 

sec 9 Family of Facts (renaming numberals, equation form) 

Example: Given 2 addends and a sum, write all the equations 
.,: possible, v 



3 + 2^5 
2 + 3^5 



5 -2^3 
5—3 = 2 



Write n equations renaming the numeral 7, 

etc* 



4 + 3^7 

5 + 2 ^ 7 

6 +1^7 



9-2^7 
8-1 - 7 
10 - 3 = 7 



Number patterns ^ _ 

Emphasis is^ on completing the pattern and/or discovering 
the rule. 

May ask "What is the next number?" or '*What rule did you 
use to find the missing number?" 



Examples: 



a. 2 


,4, 


6, ?, 


2 




4 


1 ? 




b. 4 




? 


1 ? 




4 


? 


10 


c. 3 












is 



(input/output function) 
(magic squares) 



L (1.3) (2,4) (?,5) (?,?)] (set cf 
_ number pairs) 

Properties 

Situations often arise in the teac! ing of basic facts, 
computations etc. where particular items may iTlustrate 
certain basic properties . However, for the log , we are 
interested in lesson segments where attention is given 
or drawn to a particular property or the lesson involves 
a series of computational items which involve application/ 
use of a Droperty. 
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SCC 15 (cont'd) 

. 1 



Commutatl ve (order): ariphasis or attention at this 
stage is focused on the reversabllity of order. 

Exaniples: 2 + 4 = 4 + 2 
3 X 2 « 2,x 3 
or 6 +1 = 7, 1 +6=7 (When these equations 

appear together and 
attention is drawn to 
revers ability) 

Associative (grouping): manner in which numbers are 
grouped does not affect sum. 

Examples: (2 + 3) + 5 = 5 + 5 

2 + (3 + 5) = (2 + 3) + 5 

or can be combined with expanded notation: 

78 + 2 = 70 + (8 + 2) 38 = 30 + 8 so 

=70 + 10 sa - 5 = (30 + 8) - 5 

=80 « 30 + (8 - 5) 

= 30 + 3 

= .33 

Inverse: Additiori 1s inverse of subtraction. 



13 


+ 1 = 


14 


14 


- 1 = 


13 


91 


44 




-47 


+47 




44 


91 





Identity elements: zero for addition and subtraction, 
one for multiplication. 



Examples : 



3 + 0=3 
4-0 = 4 
T X 6 = 6 
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Exampler Attendanci/Group Composition Record 



READING 



(circle one) 



Teacher No. 3 



Grade 2 



1 

"1 

1 Student' s Name 


Group 


Week Of October 27-31 , 1975 


1. ID « 239 




M 


T 


W 


th 


F 












. 2. ID # 240 ■ 


2 












ra. ID # 241 


2 . 


Absent 










. i-. ID # 242 


3 












i 5. . ID #243 


3 






Absent 






j 6. ID § 247 


2 












1 7. ID # 251 


^ 3 










- _ ^ — — - 


! 8. ID # 252 


2 






^— — ) 


u 

L-^ - E 




i 9. ID # 253 


2 


_ — ._ — _ 










; 10. ID # 254 


- 3 - 








_ - 4/> ^ 


^ _ jA - -^ — 


Ml . ID # 255 


3 






1 — 






ri2. ID # 256 


2 








- Q 


— — 


13> TD # 257 


2' 






Absent 






14. ID # 258 














1 15. ID # 259 


2 












) 16 ID # 260 


3 






— H 






^ 17. ID # 262 


3 












* 18 ID # 263 


2 






^— 1 






19. TD itf 264 


z 






i 






20. In # 265 


3 






/ 1 : 




1 21. ID # 266 


3 - - . 










22. 








I 
I 




23. . 














rz4. 










25. 








I 




26. 








—4— 
















f 28. 








i 




r 2?. 








1 : 




30. 








-_ Jl 1 _ 




' n . 








* ■— . 




i 32. 












: 33. 












1 34. 








1 
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[EACIIER 



■iPsADE ^ 



(lEADIl 



MONDAY 



TIH£: 10:30- 



-liATH 



:50 



m\}? 2 and 3 \im 31, 1^ 



CGNTEflTf 



MFft , Stiaffl 
raylt Other*" 



HATERIAL 



^10 

20 mins. 
AH 



113 

20 minSi 



no 

10 m1ns. 



AH 



AH 



CONTENT 



Adult , Ssatwork' 
him Other"" 



WEDNESDAY 



ITERIAL 



CONTENT 



Adult 



M"ult 



and 



Seatworic 
Other 



MATERIAL 



Oitto Hod. math 

write by 2's, B's^ 10's page M 



Board explanation by teicNr 

with students participating 
at board 



AH 



A as 



Mod. math 
pages 99-100 



M, math 
101-102 



110 

20 mins, 



II. 13^ 
15 mins. 



A I S 



Ditto 12 
Number, names 



"~^Tr"^[rnn~r irr i i|i iiniTiHiriPiri i ■ii ■ 

. mm, 



CONTENT 



'■^^ ana 
No Adult ' Other 



A fiMtwork 



AH NIS 

TTtto: "write "to 100. color by number dittQ(attached) 
Label even numbers with + and - facts 
blue crapn 

'10113 



'MTE^IAL 



FRIDAY 



CO'JTE'J 



Adult - J Sijtwork 
:io Adult Olher 



i ierIQ aterial 



A S 



AHH 



Ditto =-3 used sticks Correcting errors on 
set| and ptraws to do P^per^ " students working 

together in small groups with 
countiVs'aW' sets or lu. , 



ihiir work. 



HALLOWEEN ?fm 



•94- 



Teacher's Hsm 



Rating of Studant Attentlveness 



Student 



PUT A CHECK IN THE APPROPRIATE BOX 



No Adult 

O-IQg n-201 21-30X 41»5DX 51-60X 61-70$ ^7Um 81-901 91-lOW 




